SPECIFICATION 



TO ALL WHOM IT MAY CONCERN: 



BE IT KNOWN THAT I, MAIKO YAMADA, a citizen 
of Japan residing at Kanagawa, Japan have invented 
certain new and useful improvements in 

IMAGE COMPRESSION/DECOMPRESSION SYSTEM EMPLOYING PIXEL 
THINNING-OUT AND INTERPOLATION SCHEME 



of which the following is a specification:- 



BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention generally relates to an 
image compression/decompression system, in particular, 
to an image compression/decompression system employing 
efficient pixel thinning-out and interpolation schemes. 

An image compression/decompression system 
according to the present invention may be applied widely 
to various image processing application programs, 
various device drivers (software) such as printer 
drivers, also, to various image processing 
apparatus /equipment processing color images. 

2. Description of the Related Art 

With regard to image compression/decompression 
techniques, various schemes have been proposed. For 
example, Japanese laid-open patent application No. 7- 
221993 discloses a color image data thinning-out method, 
and a color image data compression method. In the 
methods, according to change rates in U data and V data 
representing color components, a size of pixel zone to 
be thinned out for each image block is controlled. 
Specifically, as the change rate is larger, the size of 
pixel zone to be thinned out is to be reduced. On the 
other hand, as the change rate is smaller, the size of 
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pixel zone to be thinned out is to be enlarged. Thereby, 
an edge line of an image is prevented from being lost 
due to thinning-out processing. 

Thus, by utilizing a characteristic of human 
eyes, a thinning-out rate is appropriately selected for 
a color component according to a color change rate for 
each image block such as that including 8x8 pixels, 16 
X 16 pixels or the like. Thereby, effective image 
compression without remarkable apparent degradation in 



H 10 image quality may be attained. 



.*M However, according to the above-described 

fi?. 

K? methods disclosed by Japanese laid-open patent 

b application No. 7-221993, a considerable time may be 

f|I required for calculating change rates in U data and V 



15 data for each image block. 

Furthermore, generally speaking, a natural 
image is likely to include a lot of thin lines/edge 
lines extending horizontally or vertically while a few 
of those extending obliquely. Therefore, when simply 

20 pixels arranged vertically are thinned out as disclosed 
by the above-mentioned patent publication as shown in 
FIG. 1, a lot of thin lines, edge lines and so forth 
included in a natural Image may be completely lost 
during image data compressing processing. 

25 



SUMMARY OF THE INVENTION 

An object of the present invention is to solve 
the above-mentioned problem, and, to provide an image 
compression/decompression schemes having a pixel 
thinning-out/interpolation schemes, by which, efficient 
image data compression/decompression can be attained by 
an effectively reduced data processing time, reduced 
data processing resources, but without remarkable 
apparent degradation in image quality during image data 
compression/decompression processing. 

For this purpose, according to the present 
invention, as shown in FIG. 2, pixels to be thinned out 
are determined to be those arranged obliquely or in a 
staggering manner, not straightly vertically or 
horizontally. Thereby, it is possible to prevent a lot 
of thin lines, edge lines and so forth extending 
horizontally or vertically included in a natural image 
from being lost through image data compressing 
processing . 

Furthermore, by selecting pixels to be thinned 
out as shown in FIG. 4 in a staggering manner, in 
comparison to a case shown in FIG. 3, distances between 
adjacent ones of the pixels to be thinned out become 
effectively elongated. Thereby, it is possible that, 
even when vertically extending thin lines included in a 



natural image are lost partially by the thinning-out 
processing, this may not result in remarkable apparent 
degradation of image quality. 

In order to achieve such thinning-out 
processing obliquely or in a staggering manner, a 
position of a pixel to be thinned out for each image 
block is determined, according to a predetermined rule, 
in such a manner that the pixels thinned out are 
prevented from becoming adjacent to each other between 
image blocks adjacent to each other vertically and 
horizontally. Thereby, it is possible to achieve 
thinning-out processing obliquely or in a staggering 
manner by a simple configuration either on a device (LSI 
or the like) or on a software program. 

An image compressing scheme according to the 
present invention comprising: 

performing pixel thinning-out operation and 
compressing image data; and 

determining a position of pixel to be thinned 
out along a first direction depending on the position 
thereof along a second direction perpendicular to the 
first direction. 

Thereby, it is possible to prevent thin 
lines/edge lines included in an original image from 
being lost remarkably apparently while higher-rate data 
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compressing can be attained with a relatively simple 
configuration . 

In the above-mentioned scheme, the position of 
pixel to be thinned out may comprise a position with 
respect to each predetermined unit area of the relevant 
image including a predetermined number of pixels. 

Thus, by performing image data compression 
processing for each unit area of the relevant original 
image, it is possible to attain high speed compression 



10 processing. 



In the scheme, the positions of pixels to be 
thinned out along the first direction may be determined 
along the second direction such that the positions of 
pixels to be thinned out do not align with one another 

15 between each pair of unit areas adjacent to one another 
along the second direction. 

Control operation performing such a manner of 
processing may be easily attained by configuring such 
that the positions of the thinned-out pixels with 

2 0 respect to the respective unit areas may be changed 
alternately every line of unit areas according to a 
simple rule, as shown in FIGS. 6A, 6B, 7, 8 and 9. Thus, 
the positions of the thinned-out pixels are located not 
continuos but intermittently, and, thus, it is possible 

25 to effectively prevent thin lines/edge lines included in 



an original image from being lost continuously. Thus, a 
high image quality may be maintained even through image 
data compressing and decompressing processes. 

An image decompressing scheme according to the 
present invention comprises: 

interpolating/generating thinned-out pixels; 

and 

determining pixels to be used for the 
interpolation , 

wherein pixels nearest to the thinned-out 
pixels may be selected for the interpolation. 

Thereby, high speed image decompressing 
processing may be attained while a high image quality 
may be maintained through image data compressing and 
decompressing processes. 

In the scheme, pixels not included in an 
original pixel block in which thinned-out pixels are 
included may be applied for interpolation/generation of 
the thinned-out pixels. 

Thereby, it is possible to utilize pixels of 
various pixel blocks (located in various directions, 
particularly, vertical and horizontal directions) for 
interpolation. Accordingly, thin lines/edge lines 
extending in various directions included in an original 
image may be effectively prevented from being lost 



during image data compressing/decompressing processing. 

The pixel to be used for interpolation may be 
determined such that pixels adjacent to an original 
pixel block (rectangular block) via short sides thereof 
may be applied. 

Thereby, it is possible to utilize pixels of 
various pixel blocks (located in various directions , 
particularly, vertical and horizontal directions) for 
interpolation. Accordingly, thin lines/edge lines 
extending in various directions included in an original 
image may be effectively prevented from being lost 
during image data compressing/decompressing processing. 

Another image decompressing scheme according 
to the present invention comprises: 

performing interpolation of thinned-out 
pixels; and 

determining a method of interpolation 
according to a pixel-number changing rate of pixel- 
number changing processing performed after the 
interpolation such that a finer interpolation method be 
selected as the pixel-number changing rate at which the 
number of pixels is increased becomes larger. 

Thereby, high speed decompressing processing 
may be attained, while a high image quality may be 
maintained during image data compressing/decompressing 
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processmg. 

In the scheme, a nearest pixel method 
(described later) may be applied when the pixel-number 
changing rate is less than a first threshold, a linear 
5 interpolation method (well-known) is applied when the 
pixel-number changing rate falls within a range between 
the first threshold and a second threshold, and a three- 
order interpolation method {described later) is applied 

£ when the pixel-number changing rate is more than the 

O 10 second threshold. 



W Thereby, it is possible to appropriately 

m 

Kl select an interpolation method according to a size of 
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image to be output after interpolation/decompression. 
In case merely a small image should be displayed as an 

15 output image, a less finer interpolation method may be 
applied so that a time required for performing image 
data decompression/interpolation may be effectively 
reduced. In contrast thereto, in case a relatively 
large image should be displayed, a finer interpolation 

20 method may be applied so that remarkable image 

degradation through image data compression which is 
likely to be apparent in such a case may be effectively 
prevented . 

Another image decompressing scheme according 
25 to the present invention comprises: 



interpolating thinned-out pixels from not- 
thinned-out pixels; and 

determining an interpolating method applied, 
so that a less finer interpolation method may 
be applied for thinned-out pixels located nearer to the 
not-thinned-out pixels used for the interpolation. 

Thereby, high speed decompressing processing 
may be attained, while a high image quality may be 
maintained during image data compressing/decompressing 
processing. 

In the scheme, a plurality of interpolation 
methods may be selectively applied for a single image 
and the interpolation method to be applied may be 
determined according to the center-to-center pixel 
distances from the not-thinned-out pixels. 

Thereby, high speed decompressing processing 
may be attained, while a high image quality may be 
maintained during image data compressing/decompressing 
processing. 

The nearest pixel method may be applied for 
thinned-out pixels most nearest to the not-thinned-out 
pixels used for interpolation, and at least one of the 
linear interpolation method and third-order 
interpolation method may be applied for the other 
thinned-out pixels. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Other objects and further features of the 
present invention will become more apparent from the 
following detailed description when read in conjunction 
with the following accompanying drawings: 

FIG. 1 illustrates a state of image data 
thinning-out processing scheme in the related art; 

FIGS. 2, 3 and 4 illustrate basic concepts of 
image data thinning-out processing schemes according to 
the present invention; 

FIG. 5 illustrates a block diagram of an image 
processing system to which first through sixteenth 
embodiments of the present invention may be applied; 

FIGS. 6A and 6B illustrate an image data 
thinning-out processing scheme according to a first 
embodiment of the present invention; 

FIG. 7 illustrates an image data thinning-out 
processing scheme according to a second embodiment of 
the present invention; 

FIG. 8 illustrates an image data thinning-out 
processing scheme according to a third embodiment of the 
present invention ; 

FIG. 9 illustrates an image data thinning-out 
processing scheme according to a fourth embodiment of 
the present invention; 
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FIG. 10 illustrates processing illustrated 
with reference to FIGS. 6A and 6B; 

FIG. 11 illustrates processing of image data 
interpolation for interpolating pixels thinned out as 
5 illustrated with reference to FIGS. 6A and 6B; 

FIG. 12 illustrates processing illustrated 
with reference to FIG. 8; 

FIG. 13 illustrates processing illustrated 
with reference to FIG . 9; 
10 FIG. 14 illustrates a basic image data 

interpolation pattern according to a fifth embodiment of 
the present invention; 

FIGS. 15A through 15C illustrate various types 
of definition of adjacent pixels for illustrating the 
15 present invention; 

FIGS. 16 and 17 illustrate specific 
interpolation processing examples according to the fifth 
embodiment of the present invention; 

FIG. 18 illustrates a basic image data 
20 interpolation pattern according to a sixth embodiment of 
the present invention; 

FIG. 19 illustrates a specific interpolation 
processing examples according to the sixth embodiment of 
the present invention; 
25 FIG. 20 illustrates a basic image data 
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interpolation pattern according to a seventh embodiment 
of the present invention; 

FIG, 21 illustrates a specific interpolation 
processing examples according to the seventh embodiment 
5 of the present invention; 

FIG. 22 illustrates a basic image data 
interpolation pattern according to an eighth embodiment 
of the present invention; 

FIG. 23 illustrates a specific interpolation 
10 processing examples according to the eighth embodiment 
of the present invention; 

FIGS. 24 and 25 illustrate a case where image 
data is enlarged in size (the number of pixels) after 
decompression/ interpolation is performed; 
Si 15 FIG. 26 illustrates processing described with 

• reference to FIGS. 18 and 19; 

FIG. 27 illustrates processing described with 
reference to FIGS. 24 and 25; and 

FIGS. 28 through 35 illustrate processing 
20 according to ninth through sixteenth embodiments of the 
present invention . 
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DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Referring to the drawings , an image 
compressing/decompressing apparatus which realizes an 



image compressing/decompressing method according to the 
present invention will now be described. In addition, 
this image compressing/decompressing method is 
realizable also on an information recording medium 
storing a software program which is executed by a 
general-purpose computer as will be described. 

FIG. 5 is a circuit block diagram showing an 
example of a configuration of an image 

compressing/decompressing apparatus which realizes an 
image compressing/decompressing method according to the 
present invention. 

As shown in FIG. 5, a printer apparatus 30 
which carries out printing output image data read out 
from a hard disk drive unit HDD 10 which stores original 
image data is connected with a personal computer PC 20 
which performs image compression processing, and images 
having undergone the image processing by the PC 20 is 
transferred to the printer apparatus 30 via a data bus 
40. 

In a random access memory RAM 1 (21) image 
data read out from the hard disk drive unit HDD 10 is 
written, so that the personal computer PC 20 may perform 
image compression thereon. A CPU 1 (22) manages and 
controls the entire personal computer PC 20. By using a 
random access memory RAM 2 (31) , a CPU 2 (32) of the 
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printer apparatus 30 performs image data decompressing 
operation on image data. The CPU2 manages and controls 
the entire printer apparatus 30. 

When original image data stored in the hard 
5 disk drive unit HDD 10 is to be printed out by the 
printer apparatus 30, the original image data is 
compressed by the personal computer PC 20, and the 
compressed image data is transmitted to the printer 
apparatus 30 through the data bus 40. By the image 
10 compression processing, since the amount of transmitting 
data to the printer apparatus 30 is reduced, the 
transmitting time is shortened, and even considering the 
time required for image compression and image 



W decompressing of the original image data, high-speed 



15 print-out operation becomes realizable. 

rl 

H First, the original image data recorded in the 

hard disk drive unit HDD 10 is read out by the CPU 1 
(22) of the personal computer PC 20, and is written into 
a reading area 21a of the random access memory RAM 1 

20 (21) according to instructions given by the CPU 1 (22) . 

The CPU 1 (22) reads out the original mage 
data from the random access memory RAM 1 (21) 
appropriately, and performs image compression processing 
thereon accordingly . 

25 The CPU 1 (22) writes the thus-compressed data 
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into a compression area 21b of the random access memory 
RAM 1 (21) , and stores there temporarily. 

After that, the CPU1 (22) gives instructions 
to the random access memory RAM 1 such that the 
5 compressed data is read out therefrom, and, via the data 
bus 40, it is transferred to the random access memory 
RAM 2 (31) in the printer apparatus 30, and, is written 
to a transfer area 31a thereof. 
Kj The CPU 2 (32) of the printer apparatus 30 

10 reads out the compressed data from the transfer area 31a 
y of the random access memory RAM 2 (31) , obtains decoding 

Ri values therefrom, performs decompressing processing on 

the compressed image data, and thus, reproduces a 
decompressed image having the number of pixels same as 
15 that of the original image data. 

Then, the CPU 2 32 writes the decompressed 
image data into a decompression area 31b of the random 
access memory RAM 2 (31), and stores there, temporarily. 

Then, the CPU2 32 reads out the decompressed 
20 data from the random access memory RAM 2 (31) , and, 

through predetermined processes, the decompressing image 
data is printed out on a print paper. 

The predetermined processes may include a 
size-change process by which the number of pixels of the 
25 image data is changed according to instructions given by 



a user or the like. 

The image compression processing carried out 
by the personal computer 20 and the image decompressing 
processing carried out by the printer apparatus 30 will 
now be described based on FIGS. 6A and 6B first, and 
then, following figures, in sequence. 

FIG. 6A illustrates a concept of a process of 
compressing an image block of 2 X 3 pixels into an image 
block of 2 x 2 pixels. FIG. 6B illustrates a state of 
thin lines A and B included in an original image 
affected by the above-mentioned compression operation. 

In this example, as shown in the figures, an 
image block of original image (original block) , from 
which pixels are thinned out, has n pixels vertically 
and m pixels horizontally, and, thus, has n x m pixels. 
Further, an image block which is thinned out from the 
above-mentioned image block (thinning-out block) of 
original image has n pixels vertically, and x pixels 

horizontally, and thus, has n x x pixels. Then, a 
compressed block obtained after the compression 
(compressed block) has n pixels vertically, and (m - x) 
pixels horizontally, and, thus, has n x (m - x) pixels. 

As shown in FIGS. 6A and 6B, in this example, 
n = 2 , m = 3 , x = 1. Thus, from the original block of 2 
x 3 pixels, the thinning-out block of 2 X 1 pixels is 
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thinned out, and, then, the compressed block of 2 X 2 
pixels remains. 

Specifically, as shown in the figures, 
according to the present invention, a position of the 
thinning-out block with respect to the original block is 
changed alternately along the vertical direction. In 
the example shown in the figures, on a first line, the 
thinning-out block is located at the left end of the 
original block, then, on a second line, differently, the 
thinning-out block is located at the right end of the 
original block, then, on a third line, the left end, . . . 
Thus, the position of the thinning-out block with 
respect to the original block is determined depending on 
the position along the vertical direction. 

Thus, above-mentioned thinning-out processing 
by an oblique manner or staggering manner can be 
attained, as shown in the figures. Thereby, as shown in 
FIG. 6B, pixels on the thin lines or edge lines A 
(vertically extending) and B (horizontally extending) 
are lost by thinning-out processing only partially, so 
that the original image may be prevented from being 
remarkably apparently degraded. 

FIGS. 6A and 6B illustrate the example in 
which the thinning-out block of n x x is thinned out 
with respect to the original block of n X m. However, 
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the present invention may also be applied to a case the 
vertical direction and horizontal direction are reversed 
from one another, where the thinning-out block of x x n 
is thinned out with respect to the original block of m X 
n, by a similar manner. 

Then, the thus-obtained compressed image data 
having 2x2 blocks may be further compressed by a well- 
known BTC (Block Truncation Coding) compressing scheme 
by which a lossy compressing scheme, and, thereby, the 
rate of compression of image data can be further 
improved . 

Next, an image interpolation processing method 
of carrying out decompressing of the compressed blocks 
obtained through image compression carried out by 
thinning-out processing as described above will now be 
described. 

In case an image compressed into the 
compressed blocks each having 2x2 pixels as shown in 
FIG. 6A are decompressed into decompressed blocks 

(corresponding to the original blocks) each having 2x3 
pixels, the image data of each pixel of the above- . 
mentioned thinned-out block which includes 2x1 pixels 
is obtained by interpolation by a nearest pixel method 
in which image data of pixels of the compressed blocks 
adjacent to the short sides of the thinned-out block is 
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used for determining image data of the pixels of the 
thinned-out block. 

For example, the thinned-out block ab shown in 
FIG . 6A has the compressed blocks gj and kn x adjacent 
thereto via the short sides thereof. The compressed 
block 'gj' of 2 x 2 pixels includes a pixel 'g 1 , a pixel 
' h', a pixel 'i', and a pixel ' j ' , and the compressed 
block kn 1 of 2 x 2 pixels includes a pixel ' k', a pixel 
'I 1 , a pixel m l7 and a pixel n 1 . In this case, the image 
data of the pixel h adjacent to the upper pixel a of the 
thinned-out block ab via the short side thereof is used 
as it is as the image data of the pixel a. Similarly, 
the image data of the pixel k adjacent to the pixel b of 
the thinned-out block ab via the bottom short side 
thereof is used as it is as the image data of the pixel 
b. Thus, interpolation is performed by the nearest 
pixel method. 

Accordingly, for example, as shown in FIG. 6B, 
in case the perpendicular thin line A exists on the 
pixels g, h, and a, b, k, and 1, as the pixel a uses the 
image data of the pixel h, and Hhe pixel b uses the 
image data of the pixel k as mentioned above through 
interpolation, the 2 pixels a and b can restore the thin 
line A properly. 

However, if the compressed blocks adjacent to 



the thinned-out block via the long sides thereof are 
used for interpolation, that is, if, for the pixel a, 
the image data of the pixel e is used, and, for the 
pixel b, the image data of the pixel f is used, the 2 
pixels may be lost for the thin line A. However, such a 
method may also be applied. 

In such a case where the interpolation is 
performed by the nearest pixel method employing 
compressed blocks adjacent to the thinned-out block via 
the long sides thereof, both the pixel e and the pixel o 
are in an equal distance from the pixel a, and, 
similarly, both the pixel f and the pixel p are in an 
equal distance from the pixel b, the following method is 
employed for determining the pixel to be used for the 
interpolation. That is, the image data of the pixel of 
the compressed block which constitutes the adjacent 
original image block to which the thinning-out block 
does not belong is used. Accordingly, for the pixel a, 
the image data of the pixel e is used, and, for the 
pixel b, the image data of the pixel f is used for the 
interpolation . 

In fact, in a case the horizontal thin line B 
exists on the pixels c, e, and a, o, and q, as shown in 
FIG. 6B, when the interpolation is made by using the 
image data of the compressed block of the 2x2 pixels 
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adjacent to the thinned-out block ab via the long side 
thereof, the image data for one pixel of the thin line B 
can be correctly restored as, for the pixel a, the image 
data of the pixel e is used, and, also, for the pixel b, 
the image data of the pixel f is used. 

However, if, in this case, the interpolation 
is made by employing the compressed block adjacent to 
the thinned-out block ab via the short side thereof, as, 
for the pixel a, the image data of the pixel h is used, 
and, also, for the pixel b, the image data of the pixel 
k is used, one pixel may be lost for the horizontal thin 
line B. However, even in this case, only the number of 
pixels corresponding to the length of the short side, 
i.e., one pixel is lost for one block. 

Thus, by employing the image data of the 
compressed block adjacent to the thinned-out block via 
the short sides thereof for interpolation, it is 
possible to efficiently reduce the number of pixels 
which are lost therethrough even when loss of pixels 
concerning a thin line or an edge line occurs therein. 
Accordingly, even employing the nearest pixel method, 
which reguires merely a reduced processing time, it is 
possible to prevent the image quality from remarkably 
degraded, with effectively reducing the processing time 
for the interpolation. 
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When image size-change (particularly, image 
magnification) processing is made in case an image after 
decompression is output, for example, if the size-change 
rate (at which the number of pixels is changed) is 
larger than a predetermined first threshold (for example, 
larger than ' 1', i.e., the number of pixels is 
increased) , a well-known linear interpolation method is 
employed instead of the above-described nearest pixel 
method. That is, for example, in case the above- 
mentioned compressed block of 2 X 2 pixels is 
decompressed as shown in FIG . 6A, the respective pixels 
of the plurality of compressed blocks adjacent to the 
relevant thinned-out block nearest to the relevant pixel 
of the thinned-out block are used for determining the 
image data of the relevant pixel. 

For example, in the example shown in FIG. 6A, 
for the pixels a and b of the thinning-out block ab, the 
image data of the nearest pixels of the compressed 
blocks * cf and 'or 1 adjacent to the relevant thinned- 
out block ab via the long sides thereof are used for 
interpolation to determine the image data of the pixels 
a and b, as follows: 

As the image data of the pixel a of the 
thinned-out block ab, the image data of the average 
value { (e + o)/2} of the pixels e and o is used; and 
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as the image data of the pixel b, the image 
data of the average value { (f + p)/2} of the pixels f 
and p is used. 

The reason for employing the linear 
5 interpolation instead of the nearest pixel method in 
case where image magnification processing is performed 
is as follows: 

In such a case, when only one pixel is 
employed for determining the image data of a thinned-out 
10 pixel according to the nearest pixel method, 

unnaturalness due to the interpolation may become 
g| remarkable. Therefore, the linear interpolation method 

n which may provide tone smoothness more effectively than 

h 

?n in the case of employing the nearest pixel method, in 

•^j 15^ general, is applied. Thereby, it may be possible to 

n 

prevent such unnaturalness from being apparent in the 
reproduced/ decompr es sed image . 

Furthermore, in case a decompressed image is 
magnified still more greatly, i.e., the size-change rate 

20 is more than a second predetermined threshold {for 

example, 2, i.e., the number of pixels is increased more 
than twice) , instead of the linear interpolation method, 
a third-order interpolation method is used in which, by 
using a three-order calculation formula, the image data 

25 of the thinned-out pixel (interpolation pixel) is 



determined by using ail the compressed blocks adjacent 

to the relevant thinned-out block. 

For example, in the example shown in FIG. 6A, 

in case the pixel a of the thinned-out block ab is 

determined when the above-mentioned compressed block of 

2X2 pixels is decompressed, the following scheme is 
applied: 

In this case, the image data of 16 pixels of 
all the four compressed blocks cf, gj , kn x and or 
adjacent to the thinned-out block ab are used. 

Specifically, the following three-order 
formula (1) is used: 

f(a) - f (c)C(x c -x a )C(y c -yJ+ f (d) C (x d -x a ) C (y d -y a ) + . . . + 
f (q)C(x q -x a )C(y q -y a )+ f (r ) C (x r -x a ) C (y r -y a ) ... (1) 

where: 

f (a) denotes interpolated image data of the 
pixel a; f{c) denotes the image data of the pixel c; 
f (q) denotes the image data of the pixel q; and f (r) 
denotes the image data of the pixel r. x a and y a denote 
x-coordinate value and y-coordinate value of the pixel a 
on color chromaticity coordinate plane, respectively. 
(x c , x d , Xq , x r ) and (y c , y d , . Yqr y r ) denote x-- 

coordinate values and y-coordinate values of pixels c, 
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d, . . , q and r on the color chromaticity coordinate 
plane , respectively . 

C(t) is an approximation formulas of a 
function { sin7tt/TCt } which constitutes a sampling theorem, 
5 and one of the following formulas (2) , (3) and (4) is 
applied according to the value of the variable t, as 
follows : 



C(t) « 1 - 2t 2 + |t| 3 , in case 0 < |t| < 1 ...(2); 
10 C(t) - 4 - 8|t| + 5t 2 - |t|\ in case 1 < |t| < 2 ...(3); 
C{t) = 0, in case 2 < |t| ... (4) 



According to the three-order interpolation 
method, as the plurality of pixels of compressed blocks 

15 present in the periphery of the relevant pixel are 
utilized, although the processing speed becomes 
decreased, it is possible to provide further higher 
image quality in comparison to the case of employing the 
linear interpolation method. 

2 0 The above-mentioned first and second 

predetermined thresholds should be determined according 
to various conditions such as image display performance 
of an image compression/decompression apparatus used, an 
observation distance at a time of observation thereof, 

25 and so forth. Accordingly, the above-mentioned values 



-27- 



(for example, 1 l r and '2* ) are merely examples. 

FIGS. 10 and 11 are flow charts showing flows 
of processing of the above-described image 
compressing/decompressing methods. That is, Fig. 10 is 
a flow chart illustrating an example of a flow of 
processing according to an image compression technology 
according to the first embodiment of the present 
invention, and FIG . 11 is a flow chart illustrating an 
example of a flow of image decompression processing 
according to the present invention for decompressing 
image data compressed according to the processing 
illustrated in FIG. 10. 

The flow of the image compression processing 
shown in FIG. 10 will now be described. 

When compressing horizontally original image 
blocks each including 2x3 pixels which is a unit area 
to be compressed, the block of 2 x 1 pixels to be 
thinned out is located in the same position with respect 
to each original block (for example, the right end) 
throughout the same line {in a step SI) . On the other 
hand, with respect to the vertical direction, the 
location of the thinned-out block of 2 X 1 pixels with 
respect to each original block of 2x3 pixels is 
determined so that the thinned-out block is not adjacent 
to any thinned-out block on the immediately preceding 
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line (for example, the left end in case the thinned-out 
block is located at the right end on the immediately 
preceding line) (in a step S2) . 

Furthermore, as for the compressed blocks each 
including 2 X. 2 pixels after thinning out the thinning- 
out blocks each of 2 x 1 pixels from the original blocks 
each of 2 x 3 pixels, lossy compression is performed 
thereon based on the BTC method (in a step S3) . 

Then, in a step S4, when all the original 
blocks have not undergone the thinning-out processing, 
the above-described process (steps SI through S3) is 
repeated. After all the original blocks have been 
processed, the image compressing processing is finished. 

The flow of image decompressing processing 
shown in Fig. 11 will now be described. 

Image data having 2x2 pixels which is a 
compressed block is read (in a step Sll) . 

Then, a size-change rate a (pixel number 
change rate) on the relevant image for size change 
processing (pixel number change processing) performed 
when the decompressed image is output is determined (in 
a step S12) . 

In case the size-change rate is not more than 
the first predetermined threshold (for example, "1"), 
interpolation is performed according to the nearest 
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pixel method such that the image data of each pixel of 
the thinned-out block is determined from the image data 
of the pixel adjacent thereto via the short side of the 
block, as described above (in a step S13) . 
5 In case the size-change rate is more than the 

first predetermined threshold (for example, "1") and 
also not more than the second predetermined threshold 
(for example, "2") , interpolation is performed according 
to the linear interpolation method such that the image 
10 data of each pixel of the thinned-out block is 

determined from the image data of the pixels nearest 
thereto of the plurality of compressed blocks adjacent 
to the thinned-out block, for example, via the long 
sides thereof, as described above (in a step S14) . 

15 In case the size-change rate is more than the 

H 

M second predetermined threshold (for example, "2" ), 

h« interpolation is performed according to the three-order 

interpolation method such that the image data of each 
pixel of the thinned-out block is determined from the 
20 image data of the respective pixels of all the 

compressed blocks adjacent to the thinned-out block, as 
described above (in a step S14) . 

With reference to FIG. 7, image compression 
scheme and interpolation scheme according to a second 
25 embodiment of the present invention in case the number 
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of pixels in a vertical direction of thinning- 
out/thinned-out block is equal to or more than three 
will now be described. 

In FIG . 7, in case color image data is 
5 compressed, each of original image blocks from which 

thinning-out blocks are thinned out/removed includes 3 x 
3 pixels. In the figure, 3x2 pixels shown as a white 
portion of each original image block are extracted as a 
compressed block after image compression, and 3x1 
P 10 pixels shown as a hatched portion at the right or left 



HI 



i.. s 

'Si 

o 



end of each original image block are removed as a 
thinned-out block, 
flf Specifically, during image data compression 

according to the second embodiment of the present 
15 invention illustrated by FIG . 7 , on the horizontal 

direction, the position of the thinning-out/thinned-out 
block with respect to each original image block is the 
same for the same line. However, on the vertical 
direction, the position of the thinning-out/thinned-out 
20 block with respect to each original image block is 

determined so that the thinning-out/thinned-out block 
may not be adjacent to or may not align with any 
thinning-out/thinned-out block on the immediately 
preceding line. For example, in the example shown in 
25 FIG. 7, the position of the thinning-out/thinned-out 
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block is the right end with respect to each original 
image block on the first line, but is the left end on 
the second line, then is the right end on the third 
line, .... By thus proceeding with thinning-out 
processing by repeating for respective lines of original 
image blocks according to the simple rule, the thinning- 
out/thinned-out blocks are positioned so that they are 
not adjacent to or not aligned with each other, as shown 
in FIG. 7, for example. 

Also in this embodiment, it is possible that 
the horizontal direction and vertical direction are 
replaced with one another. That is, the position of the 
thinning-out/thinned-out block is the same on the same 
column for the vertical direction, and, the position 
thereof is determined so that the thinning-out/thinned- 
out block may not adjacent to or may not align with any 
thinning-out/thinned-out block on the immediately 
preceding column. 

Thereby, as the respective thinning- 
out/thinned-out blocks are not adjacent to or not 
aligned with each other between any adjacent original 
image blocks, a situation that all the pixels arranged 
straightly in horizontal direction or vertical direction 
are thinned out/removed by compression processing can be 
positively prevented. Accordingly, it is possible to 
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prevent thin line/edge lines extending vertically or 
horizontally from being lost remarkably through image 
compression and decompression processing. Thus, it is 
possible to maintain a high image quality. 
5 Then, after the above-described thinning-out 

processing, the above-mentioned BTC compression (lossy 
compression) is performed on the compressed blocks, and, 
thereby, the compression rate is further increased. 
Image interpolation scheme in image 
CI 10 decompression of the thus-obtained compressed image data 

will now be described. 

According to the second embodiment, as shown 
HI in FIG. 7, the number of pixels of each thinning- 

out/thinned-out block in the vertical direction is more 
15 than two. Accordingly, both vertical end pixels of the 
thinning-out/thinned-out block are determined by the 
pixels of the compressed blocks adjacent to the 
thinning-out/thinned-out block via the short sides 
thereof in the nearest pixel method as in the above- 
20 described first embodiment. In contrast thereto, as to 
the intermediate pixel, the image data thereof is 
determined by the image data of the pixel of the 
compressed block adjacent to the thinning-out/thinned- 
out block via the long side thereof but not included in 
25 the original image block in which the relevant thinning- 
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out/thinned-out block is included. 

Specifically, in the example shown in FIG. 7, 
the thinning-out/thinned-out block ac of 3 X 1 pixels 
includes pixels a, b and c; the compressed block jo of 3 
x 2 pixels includes j, k, 1, m lf n x/ and o adjacent to 
the above-mentioned thinning-out/thinned-out block ac 
via the top short side thereof; the compressed block pu 
of 3 x 2 pixels includes p r q r r, s, t, and u adjacent 
to the above-mentioned thinning-out/thinned-out block ac 
via the bottom short side thereof; and the compressed 
block di of 3 x 2 pixels includes d, e, f, g, h, and i 
adjacent to the above-mentioned thinning-out/thinned-out 
block ac via the left long side thereof but not included 
in the original image block in which the thinning- 
out/thinned-out block ac is included. 

In this case, according to the above-described 
scheme, the image data of the top pixel a of the 
thinning-out/thinned-out block ac is determined as the 
image data of the pixel 1 adjacent thereto on the top 
side; the image data of the bottom pixel c of the 
thinning-out/thinned-out block ac is determined as the 
image data of the pixel p adjacent thereto on the bottom 
side; and the image data of the intermediate pixel b of 
the thinning-out/thinned-out block ac is determined as 
the image data of the pixel h adjacent thereto on the 
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left side. 

Thereby, similarly to the case of the above- 
described first embodiment illustrated in FIGS . 6A and 
6B, as the pixels of the thinning-out/thinned-out block 
5 adjacent to the short sides thereof are determined by 
using the pixels of the compressed blocks adjacent to 
the thinning-out/thinned-out block via the short sides 
thereof according to the nearest pixel method, it is 
possible to effectively reduce the number of pixels lost 
p 10 from thin line/edge line extending vertically during 

r[ image compression and decompression processing. 

fl\ , Furthermore, as to the intermediate pixel of 

■2 the thinning-out/thinned-out block, the image data 

J thereof is determined by using the nearest pixel but 

[V 15 adjacent to the pixel to be determined in the direction 

"""4 other than the direction of the above-mentioned case of 

"H interpolation manner for the pixels adjacent to the 

short sides of the thinning-out/thinned-out block. 
Accordingly, the direction of interpolation is not fixed 
20 to vertical or horizontal, but various directions are 

used for the interpolation. Thereby, it is possible to 
easily maintain the image quality from remarkably 
degraded. 

Thus, according to the second embodiment, same 
25 as in the first embodiment, as the pixel thinning scheme 
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is improved, it is possible to maintain a high image 
quality during image compression and decompression by- 
interpolation although employing the nearest pixel 
method which merely requires a reduced processing time. 
5 Accordingly, it is possible to attain high speed 
interpolation processing. 

In the second embodiment, the flows of 
processing of image compression and image decompression 
are the same as those of the above-described first 

fci 10 embodiment illustrated in FIGS. 10 and 11. However, 

Q 

H different from the first embodiment, the original image 

111 

Cm block has 3x3 pixels, and the thinning-out/thinned-out 

pj block has 3x1 pixels, as mentioned above. Especially, 

is 

according to the second embodiment, as the number of 

fll 

'il 15 pixels of the thinning-out/thinned-out block along the 

Si 

$*l vertical direction is more than two, image data of the 

intermediate pixel (s) is determined in decompression 
processing by using the pixel (s) of the compressed block 
adjacent to the thinning-out/thinned-out block but not 
20 included in the original image block in which the 

thinning-out /thinned-out block is included, as described 
above . 

Although the above-described second embodiment 
employs the original block of 3 x 3 pixels and thinning- 
25 out/thinned-out block of 3 x 1 pixels, the basically 
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same concept may be applied to a case where the number 
of pixels along the vertical direction increases more 
than three, i.e., four, five, .... That is, the concept 
of the second embodiment may also be applied to a case 
5 employing the original block of 4 x 3 pixels and 

thinning-out/thinned-out block of 4 x 1 pixels, .... In 
such a case, the number of the above-mentioned 
intermediate pixels becomes more than one, i.e., two, 
three , ... 

p 10 With reference to FIG. 8, image compression 

Zi scheme and interpolation scheme according to a third 

%l embodiment of the present invention in case the number 

'lf % of pixels of thinning-out/thinned-out block is half the 

number of the original image block will now be described. 

hi; 

pf 15 In FIG. 8, in case color image data is 

*jj compressed, each of original image blocks from which 

H thinning-out blocks are thinned out includes 2x4 

pixels,. In the figure, 2x2 pixels shown as a white 
portion of each original image block are extracted as a 
20 compressed block after image compression, and 2x2 

pixels shown as a hatched portion at the right or left 
end of each original image block are removed off as a 
thinned-out block. 

Specifically, during image data compression 
2 5 according to the third embodiment of the present 
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invention illustrated by FIG. 8, on the horizontal 
direction , the position of the thinning-out/thinned-out 
block with respect to each original image block is the 
same for the same line. However , on the vertical 
5 direction, the position of the thinning-out/thinned-out 
block with respect to each original image block is 
determined so that the thinning-out/thinned-out block 
may not be adjacent to or may not align with any 
thinning-out/thinned-out block on the immediately 

10 preceding line. For example, in the example shown in 
FIG. 8, the position of the thinning-out/thinned-out 
block is the right end with respect to each original 
image block on the first line, but is the left end on 
the second line. By proceeding with thinning-out 

15 processing by repeating for respective lines of original 
image blocks according to the simple rule, the thinning- 
out/thinned-out blocks are positioned so that they are 
not adjacent to or not aligned with each other, as shown 
in FIG. 8, for example. 

20 Also in this embodiment, it is possible that 

the horizontal direction and vertical direction are 
replaced with one another. That is, the position of the 
thinning-out/thinned-out block is the same on the same 
column for the vertical direction, and, the position 

25 thereof is determined so that the thinning-out/thinned- 
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out block may not adjacent to any thinning-out/thinned- 
out block on the immediately preceding column. 

Thereby, as the respective thinning- 
out/thinned-out blocks are not adjacent to or not 
5 aligned with each other between any adjacent original 
image blocks, a situation that all the pixels arranged 
straightly in horizontal direction or vertical direction 
are thinned out/removed by compression processing can be 
positively prevented. Accordingly, it is possible to 

10 prevent thin line/edge line extending vertically or 

horizontally from being lost remarkably through image 
compression and decompression processing. Thus, it is 
possible to easily maintain a high image quality. 

Then, after the above-described thinning-out 

15 processing the above-mentioned BTC compression (lossy 

compression) is performed on the compressed blocks, and, 
thereby, the compression rate is further increased. 

Image interpolation scheme in image 
decompression of the thus-obtained compressed image data 

20 will now be described. 

In order to obtain a decompressed block of 2 x 
4 pixels from the compressed block of 2 x 2 pixels 
through decompression in the example shown in FIG. 8, 
the above-mentioned thinning-out/ thinned-out block is 

25 obtained by interpolation by using the pixels of the 



compressed blocks adjacent to the thinning-out/thinned- 
out block via the short sides thereof according to the 
nearest pixel method. 

Specifically, in the example shown in FIG. 8, 
the thinning-out/thinned-out block ad of 2 X 2 pixels 
includes pixels a, b, c and d; the compressed block il 
of 2 X 2 pixels includes i, j, k and 1 adjacent to the 
above-mentioned thinning-out/thinned-out block ad via 
the top short side thereof; the compressed block mjp of 
2x2 pixels includes m z , n lf o and p adjacent to the 
above-mentioned thinning-out/thinned-out block ad via 
the bottom short side thereof. 

In this case, according to the above-described 
scheme, the image data of the top pixel a of the 
thinning-out/thinned-out block ad is determined as the 
image data of the pixel j adjacent thereto on the top 
side; the image data of the top pixel b of the thinning- 
out/thinned-out block ad is determined as the image data 
of the pixel m 1 adjacent thereto on the bottom side; the 
image data of the top pixel c of the thinning- 
out/thinned-out block ad is determined as the image data 
of the pixel 1 adjacent thereto on the top side; the 
image data of the top pixel d of the thinning- 
out/thinned-out block ad is determined as the image data 
of the pixel o adjacent thereto on the bottom side, as 
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shown in FIG. 8. 

Thereby, similarly to the case of the above- 
described first embodiment illustrated in FIGS . 6A and 
6B, as the pixels of the thinning-out/thinned-out block 
5 adjacent to the short sides thereof are determined by 
using the pixels of the compressed blocks adjacent to 
the thinning-out/thinned-out block via the short sides 
thereof according to the nearest pixel method, it is 
possible to effectively reduce the number of pixels lost 

his 

El 10 from thin line/edge line extending vertically during 

H image compression and decompression processing. Thereby, 

V s 

CH it is possible to easily maintain the image guality. 

||1 Thus, even when thin line/edge line is lost through 

| a b compression and decompression, the number of pixels lost 

15 can be effectively reduced. 

Thus, also according to the third embodiment, 
same as in the first embodiment, as the pixel thinning 
scheme is improved, it is possible to maintain a high 
image quality during image compression and decompression 
20 by interpolation although employing the nearest pixel 
method which requires reduced processing time. 
Accordingly, it is possible to attain high speed 
interpolation processing. 

In the third embodiment, as shown in FIG. 12, 
25 when compressing horizontally original image blocks each 



nj 

s . 
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including 2x4 pixels which is a unit area to be 
compressed, the block of 2 X 2 pixels to be thinned out 
is located in the same position with respect to each 
original block (for example, the right end) throughout 
the same line (in a step S21) . On the other hand, with 
respect to the vertical direction, the location of the 
thinned-out block of 2 X 2 pixels with respect to each 
original block of 2 X 4 pixels is determined so that the 
thinned-out block is not adjacent to or not aligned with 
the thinned-out block on the immediately preceding line 
(for example, the left end in case the thinned-out block 
is located at the right end on the immediately preceding 
line) (in a step S22) . 

Furthermore, as for the compressed blocks each 
including 2x2 pixels after thinning out the thinning- 
out blocks each of 2 x 2 pixels have been thinned out 
from the original blocks each of 2 x 4 pixels, lossy 
compression is made based on the BTC method (in a step 
S23) . 

Then, in a step S24, when all the original 
blocks have not undergone the thinning-out processing, 
the above-described process (steps S21 through S23) is 
repeated. After all the original blocks have been 
processed, the image compressing processing is finished. 

The flow of processing of image decompression 
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is the same as that of the above-described first 
embodiment illustrated in FIG . 11. However, different 
from the first embodiment, the original image block has 
2x4 pixels, and the thinning-out/thinned~out block has 
2x2 pixels, as mentioned above. 

With reference to FIG. 9, image compression 
scheme and interpolation scheme according to a fourth 
embodiment of the present invention in case the number 
of pixels of the thinning-out/thinned-out block is 
smaller than half the number of pixels of the original 
image block will now be described. 

In FIG. 9, in case color image data is 
compressed, each of original image blocks from which 
thinning-out blocks are thinned out includes 2x3 
pixels. In the figure, 2x1 pixels shown as a white 
portion of each original image block are extracted as a 

compressed block after image compression, and 2x2 
pixels shown as a hatched portion at the right or left 
end of each original image block are removed as a 
thinned-out block. 

Specifically, during image data compression 
according to the fourth embodiment of the present 
invention illustrated by FIG . 9, in the horizontal 
direction, the position of the thinning-out/thinned-out 
block with respect to each original image block is the 
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same for the same line. However, in the vertical 
direction, the position of the thinning-out/thinned-out 
block with respect to each original image block is 
determined so that the compressed block to be left, 
instead of the thinning-out/thinned-out block, may not 
be adjacent to or may not aligned with any compressed 
block on the immediately preceding line. For example, 
in the example shown in FIG. 9, the position of the 
compressed block is the left end with respect to each 
original image block on the first line, but is the right 
end on the second line. By proceeding with thinning-out 
processing by repeating for respective lines of original 
image blocks according to the simple rule, the 
compressed blocks are positioned so that they are not 
adjacent to or not aligned with each other, as shown in 
FIG. 9, for example. 

Also in this embodiment, it is possible that 
the horizontal direction and vertical direction are 
replaced with one another. That is, the position of the 
thinning-out/thinned-out block is the same on the same 
column for the vertical direction, and, the position of 
the compressed block is determined so that the 
compressed block to be left may not adjacent to or may 
not align with any compressed block on the immediately 
preceding column. 
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Thereby, as the respective compressed blocks 
are not adjacent to or not aligned with each other 
between any adjacent original image blocks, a situation 
that all the pixels arranged straightly in horizontal 
direction or vertical direction are thinned out/removed 
by compression processing can be prevented. Accordingly, 
it is possible to prevent thin line/edge line extending 
vertically or horizontally from being lost through image 
compression and decompression processing. Thus, it is 
possible to maintain high image quality. 

Then, after the above-described thinning-out 
processing the above-mentioned BTC compression {lossy 
compression) is performed on the compressed blocks, and, 
thereby, the compression rate is further increased. 

According to the fourth embodiment, in 
comparison to the first embodiment, the compression rate 
can be improved from 1.5 to 3. Accordingly, it is 
possible to effectively reduce a transmission time from 
the personal computer 20 to the printer apparatus 30. 

Image interpolation scheme in image 
decompression of the thus-obtained compressed image data 
will now be described. 

In order to obtain a decompressed block of 2 x 
3 pixels from the compressed block of 2 x 1 pixels 
through decompression in the example shown in FIG. 9, 
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the above-mentioned thinning-out/thinned-out block is 
obtained by interpolation by using the pixels of the 
compressed blocks adjacent to the thinning~out/thinned- . 
out block via the short sides thereof according to the 
nearest pixel method. 

Specifically, in the example shown in FIG. 9, 
the thinning-out/thinned-out block ad of 2 X 2 pixels 
includes pixels a, b, c and d; the compressed block gh 
of 2 x 1 pixels includes g and h adjacent to the above- 
mentioned thinning-out/thinned-out block ad via the top 
short side thereof; the compressed block ef of 2 x 1 
pixels includes e and f adjacent to the above-mentioned 
thinning-out/thinned-out block ad via the left short 
side thereof; the compressed block ij of 2 x 1 pixels 
includes i and j adjacent to the above-mentioned 
thinning-out/thinned-out block ad via the bottom short 
side thereof; and the compressed block kl of 2 x 1 
pixels includes k and 1 adjacent to the above-mentioned 
thinning-out/thinned-out block ad via the right short 
side thereof, as shown in the figure. 

In this case, according to the above-described 
scheme, the image data of the top pixel a of the 
thinning-out/thinned-out block ad is determined as the 
image data of the pixel h adjacent thereto on the top 
side; the image data of the bottom pixel b of the 
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thinning-out/thinned-out block ad is determined as the 
image data of the pixel i adjacent thereto on the bottom 
side; the image data of the top pixel c of the thinning- 
out/thinned-out block ad is determined as the image data 
of the pixel k adjacent thereto on the right side; and 
the image data of the top pixel d of the thinning- 
out/thinned-out block ad is determined as the image data 
of the pixel 1 adjacent thereto on the right side, as 
shown in FIG. 9. 

Thereby, similarly to the case of the above- 
described first embodiment illustrated in FIGS . 6A and 
6B, as the pixels of the thinning-out/thinned-out block 
adjacent to the short sides thereof are determined by 
using the pixels of the compressed blocks adjacent to 
the thinning-out/thinned-out block via these short sides 
thereof according to the nearest pixel method, it is 
possible to effectively reduce the number of pixels lost 
from thin line/edge line extending vertically during 
image compression and decompression processing. 
Accordingly, the direction of interpolation is not fixed 
to vertical or horizontal, but various directions are 
used for the interpolation. Thereby, it is possible to 
easily maintain the image quality. Thus, even when thin 
line/edge line is lost through compression and 
decompression, the number of pixels lost can be 



effectively reduced. 

In each of the above-mentioned second through 
fourth embodiments, it is also possible to employ the 
above-described linear interpolation method or three- 
order interpolation method instead of the nearest pixel 
method, as described above. 

Thus, also according to the fourth embodiment, 
same as in the first embodiment, as the pixel thinning 
scheme is improved, it is possible to maintain a high 
image quality during image compression and decompression 
by interpolation although employing the nearest pixel 
method which requires reduced processing time. 
Accordingly, it is possible to attain high speed 
interpolation processing. 

In the fourth embodiment, as shown in FIG. 13, 
when compressing horizontally original image blocks each 
including 2x3 pixels which is a unit area to be 
compressed, the block of 2 X 2 pixels to be thinned out 
is located in the same position with respect to each 
original block (for example, the right end) throughout 
the same line (in a step S31) . On the other hand, with 
respect to the vertical direction, the location of the 
compressed block of 2 x 1 pixels with respect to each 
original block of 2 x 3 pixels is determined so that the 
compressed block is not adjacent to or not aligned with 
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any compressed block on the immediately preceding line 
(for example, the left end in case the thinned-out block 
is located at the right end on the immediately preceding 
line) (in a step S32) . 

Furthermore, as for the compressed blocks each 
including 2x1 pixels after thinning out the thinning- 
out blocks each of 2 X 2 pixels have been thinned out 
from the original blocks each of 2 x 3 pixels, lossy 
compression is made based on the BTC method (in a step 
S33) . 

Then, in a step S34, when all the original 
blocks have not undergone the thinning-out processing, 
the above-described process (steps S31 through S33) is 
repeated. After all the original blocks have been 
processed, the image compressing processing is finished. 

The flow of processing of image decompression 
is the same as that of the above-described first 
embodiment illustrated in FIG. 11. However, different 
from the first embodiment, the original image block has 
2x3 pixels, and the thinning-out/thinned-out block has 
2x2 pixels, as mentioned above. 

After that, embodiments of how to select one 
of, and/or to combine the above-mentioned nearest pixel 
method, linear interpolation method and three-order 
interpolation method according to positions of thinning- 
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out/thinned-out pixels to be generated from a compressed 
block with respect to the positions of pixels of the 
compressed block will now be described. According to 
the schemes of the embodiments which will be described 
5 now, it is possible to prevent an image quality from 
being remarkably apparently degraded during image 
compression and decompression processes, even when 
relatively large areas are thinned out through the 
compression process so as to increase the compression 
10 rate. 

FIG. 14 illustrates a basic interpolation 
pattern in an image interpolation method according to 
the embodiments which will be described now. With 

fa S 

regard to color image data, 5x5 pixels are used as a 
,..!;f. 15 unit, and, when the 5X5 pixels are generated from 2 x 

y. 

H* 2 pixels (indicated by black in the figure) , two types 

of interpolation methods are used for pixels other than 
the pixels indicated by black. For example, in case the 
pixels (indicated by gray in the figure) are adjacent to 

20 the pixels of the black zone as shown in the figure, the 
first interpolation method is applied to generate the 
pixels of the gray zone while the second interpolation 
method, different from the first interpolation method, 
is applied to generated the other pixels (indicated by 

25 white) . 
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FIGS. 12A through 12C illustrate definition of 
"adjacent pixels" applied to the description below. 
First, FIG. 12A shows adjacent pixels (gray zone) of 
image area indicated by black. As shown in the figure, 
the adjacent pixels are those possessing a side or a 
vertex of the relevant image area (black zone) in common. 
The meaning of "in common" in this case is a conceptual 
one, and, thus, may also be widely applied to a case 
respective pixels are spaced from each other. FIG. 12B 
shows adjacent pixels (gray zone) of the two sides q and 
q of the relevant image area (black zone) in case the 
relevant image zone has a rectangular shape as shown in 
the figure. FIG. 12C shows adjacent pixels (gray zone) 
of the respective four sides p, q, s and r of the 
relevant image area (black zone) . A term "pixel group" 
which will occur also means a single pixel. 

FIG. 16 illustrates one example of image 
interpolation method according to a fifth embodiment of 
the present invention. As shown in the figure, for the 
gray zone, the interpolation is performed according to 
the nearest pixel method, and, thus, the image data of 
the adjacent pixel of the black zone is applied as it is 

so that (1) -> (1); (3) -> (3); (5) -> (5) , With 

regard to the white zone, the linear interpolation 
method is applied, and, thus, ((1) + (2))/2 ~> (9); ((5) 
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+ (7))/2 -» (10); ((3) + (4))/2 -> (11); ((5) + (6))/2 -> 
(12); ((7) + (8))/2 -> (13); ((6) + (8))/2 -> (14); ((12) 
+ (13) ) /2 -> (15) . 

FIG. 17 shows another example of the image 
5 interpolation method according to the fifth embodiment 
of the present invention. Also in this example, same as 
in the example shown in FIG. 16, the image data of the 
pixels in the gray zone is determined by the nearest 
pixel method by using the image data of the pixels in 
10 the black zone as shown in the figure. However, the 
JJ~ image data of the pixels in the white zone is determined 

jjM according to the three-order interpolation method. 

*. Specifically, assuming that the coordinate 

FU system of the original image is of X-Y while the 

U 



Q 



15 coordinate system of the image data after coordinate 
transformation is of X'-Y', the relationship 
therebetween can be expressed by the following formulas 
(I) and (II) assuming that the relationship between both 
the coordinate systems is linear: 

20 

x = ax ' + by 1 + c . . . (I) ; 

y = dx ' + ey ' + f ... (II) 



25 



Accordingly, the relationship between both the 
coordinate systems can be obtained from calculating of 



the above-mentioned constants a, b, c, d, e and f by 
using corresponding actual coordinate values on six 
points. In the calculation, these six points are not 
necessarily to be lattice points (integral coordinate 
values) . 

Then, by using the above-mentioned formulas 
(I) end (II) , for all the points of an image obtained 
after the transformation, corresponding points on the 
original image are obtained, and, color information on 
the points on the original image is used as color 
information of the points on the transformed image. 
However, as all the points on the original image may not 
be lattice points, desired color information should be 
obtained by using the color information of peripheral 
lattice points. In such a case, the above-mentioned 
three-order interpolation method is used for obtaining 
the desired color information by using the color 
information on the peripheral lattice points. 

Accordingly, the same manner may be applied to 
the case of interpolating pixels in the white zone from 
pixels in the black/gray zones. Specifically, the 
pixels (1) through (16) in the black zone shown in FIG. 
17 are assumed to be points G through V, and the pixel 
(17) in the white zone is assumed to be a point Z. Then, 
by using image data f(G) through f (V) on the 16 points G 
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through V, the image data f (Z) on the pixel (17) is 
determined through interpolation {third-order 
interpolation) , by using the following formulas (III) 
through (VI) : 

f (Z)~f (G)C(x G -x 2 )C(y G -y z )+ f (H) C <x H -x z ) C (y H -y z ) + ... 
+ f (V)C(x v -x z )C(y v -y z ) . . . (Ill) ; 

C(t) « 1 - 2t 2 + |t| 3 , in case 0 < |t| < 1 ... (IV) ; 

C(t) = 4 - 8|t| + 5t 2 - |t| 3 , in case 1 < |t| < 2 . . . (V) ; 
C(t) =0, in case 2 < |t| ... (VI) 

There, C(t) represents an approximation 
formula of function sin7tx/7tx which expresses a sampling 
theorem, and the .formulas (III) through (VI) are used 
for each component of R, G, B of color image data. 

According to this method, as information of as 
many as 16 points is used, it is possible to provide a 
higher-quality image in comparison to a case of using 
the linear interpolation method. 

- At this time, in case m - x > 3 and n - y > 3 
or 2x < m and 2y < n {see FIG. 14) , a plurality of the 
above-described interpolation methods are selectively 
used. This is because, in such a case, it is necessary 
to select an appropriate one thereof according to the 
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length of (m - x) and (n - y) . For example, when the 
lengths of (m - x) and (n - y) are smaller (compression 
rate is smaller) , the linear interpolation method (less 
finer interpolation method) may be applied for the white 
zone, while, when these lengths are larger (compression 
rate is larger) , the three-order interpolation method 
(finer interpolation method) may be applied for the 
white zone. There, each of m, n, x and y represents the 
number of pixels. In the example of FIG. 14, n = 5; m = 
5, x = 2 f and y — 2. In this case, the gray zone (to 
which the nearest pixel method is applied as mentioned 
above) has the width of one pixel, as shown in the 
figure. This is because, as the image data of the gray 
zone is generated by using the black zone as it is 
according to the nearest pixel method, the image quality 
may be degraded if the gray zone has a wide area in 
comparison to the area of the black zone. 

FIG. 18 illustrates an example of a basic 
interpolation pattern according to a sixth embodiment of 
the present invention. Similar to FIG. 14, 5X5 pixels 
are used as a unit of color image data, and, by 
decompression through interpolation, 5x5 pixels are 
generated from 2x2 pixels in a black zone. Then, for 
determining pixels other than the black zone, a 
plurality of interpolation methods are selectively used. 



In particular, in the example of FIG. 18, different from 
the above-described example shown in FIG. 14, the pixel 
having a distance P in a center-to-center basis from the 
pixel in the black zone which is longest among the 
distances a, P and y is determined as a white pixel, and, 
the image data of the pixels in the gray zone are 
determined according to a first interpolation method 
while the image data of the pixel in the white zone is 
determine by a second interpolation method other than 
the first interpolation method. 

Specifically, in a example shown in FIG. 19, 
the nearest pixel method is used for the gray zone, and 
the linear interpolation method is used for the white 
zone. Thus, the image data of the pixels in the white 
zone is determined as the image data of the pixels 
adjacent thereto respectively, as follow, as shown in 

the figure: (1) (1); (5) (5); (3) -> (3) ; On 

the other hand, the image data on the pixels in the 
white zone is determined according to the linear 
interpolation method as follows: ((1) + (2))/2 -> (9); 
((5) + (7))/2 -> (10); ((3) + (4))/2 -> (11); ((5) + 
(6)>/2 -> (12); ((7) + (8))/2 -> (13); ((6) + (8))/2 -> 
(14); ((7) + 3 X (5))/4 -> (15); ((7) + 2 X (15) ) /3 
(16); ((7) + (16))/2 -> (17); {(13) + 3 X (12))/4 -> 
(18); ((13) + 2 X (18))/3 -> (19); ((13) + (19))/2 -» 
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(20) . 

Also at this time, in case m - x > 3 and n - y 
> 3 or 2x < m and 2y < n (see FIG. 18) , a plurality of 
interpolation methods are used. This is because, in 
5 such a case, it is necessary to select an appropriate 
one thereof according to the length of (m - x) and (n - 
y) . For example, when the lengths of (m - x) and (n - 
y) are smaller (compression rate is smaller) , the linear 
interpolation method (less finer interpolation method) 

10 may be applied for the white zone, while, when these 
lengths are larger (compression rate is larger) , the 
three-order interpolation method (finer interpolation 
method) may be applied for the white zone. There, each 
of m, n, x and y represents the number of pixels. In 

15 the example of FIG. 18, n=5;m=5, x=2, and y = 2. 
In this case, the gray zone (to which the nearest pixel 
method is applied as mentioned above) has the width of 
one pixel, as shown in the figure. This is because, as 
the image data of the gray zone is generated by using 

20 the black zone as it is according to the nearest pixel 
method, the image quality may be degraded if the gray 
zone has a wider area in comparison to the area of the 
black zone. 

FIG. 20 illustrates an example of a basic 

2 5 interpolation pattern according to a seventh embodiment 



of the present invention. Similar to FIG. 14, 5x5 
pixels are used as a unit of color image data, and, by- 
decompression through interpolation, 5x5 pixels are 
generated from 2x2 pixels in a black zone. Then, for 
determining pixels other than the black zone, a 
plurality of interpolation methods are selectively used. 
In particular, the pixels adjacent to the four sides of 
the black zone are determined as those in a gray zone, 
and, the image data of the pixels in the gray .zone are 
determined according to a first interpolation method 
while the image data of the pixel in the white zone, 
other than the black zone and gray zone, is determine by 
a second interpolation method other than the first 
interpolation method. By employing this basic 
interpolation pattern, it is possible to maintain a high 
image quality particularly for non-edge image part. 

Specifically, in an example shown in FIG. 21, 
the nearest pixel method is used for the gray zone, and 
the linear interpolation method is used for the white 
zone. Thus, the image data of the pixels in the gray 
zone is determined as the image data of the pixels in 
the black zone adjacent thereto respectively, as follow, 
as shown in the figure: (1) -> (1); (2) (2); (4) -> 
(4); (3) — » (3); .... On the other hand, the image data 
on the pixels in the white zone is determined according 
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to the linear interpolation method as follows: ((2) + 
(5))/2 -» (7); and ((4) + (6))/2 -> (8). 

Also at this time, in case m - x > 3 and n - y 
> 3 or 2x < m and 2y < n (see FIG. 20) , a plurality of 
interpolation methods are used. This is because, in 
such a case, it is necessary to select an appropriate 
one thereof according to the length of (m - x) and (n - 
y) . For example, when the lengths of (m - x) and (n - 
y) are smaller (compression rate is smaller) , the linear 
interpolation method (less finer interpolation method) 
may be applied for the white zone, while, when these 
lengths are larger (compression rate is larger) , the 
three-order interpolation method (finer interpolation 
method) may be applied for the white zone. There, each 
of m, n, x and y represents the number of pixels. In 
the example of FIG. 20, n = 5; m = 5, x = 2, and y = 2. 
In this case, the gray zone (to which the nearest pixel 
method is applied as mentioned above) has the width of 
one pixel, as shown in the figure. This is because, as 
the image data of the gray zone is generated by using 
the black zone as it is according to the nearest pixel 
method, the image quality may be degraded if the gray 
zone has a large area in comparison to the area of the 
black zone. 

FIG. 22 illustrates an example of a basic 
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interpolation pattern according to an eighth embodiment 
of the present invention. Similar to FIG. 14, 5x5 
pixels are used as a unit of color image data, and, by 
decompression through interpolation, 5x5 pixels are 
generated from 2x2 pixels in a black zone. Then, for 
determining pixels other than the black zone, a 
plurality of interpolation methods are selectively used. 
In particular, in the example of FIG . 22, similar to the 
above-described example shown in FIG. 18, the pixel 
having a distance P in a center-to-center basis from the 
pixel in the black zone which is longest among the 

distances a, j3 and 7 is determined as a white pixel, and, 
the image data of the pixels in the gray zone are 
determined according to a first interpolation method 
while the image data of the pixel in the white zone is 
determine by a second interpolation method other than 
the first interpolation method. Also the scheme 
according to this basic interpolation pattern is 
advantageous for maintaining a high image quality for 
non-edge image parts. 

Specifically, in a example shown in FIG. 23, 
the nearest pixel method is used for the gray zone, and 
the linear interpolation method is used for the white 
zone. Thus, the image data of the pixels in the gray 
zone is determined as the image data of the pixels 
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adjacent thereto respectively, as follow, as shown in 
the figure: (1) (1); (2) -> (2); (4) (4); (3) -> 
(3) ; .... On the other hand, the image data on the 
pixels in the white zone is determined according to the 
linear interpolation method as follows: ((2) + (5))/2 — > 
(9); ((4) + (7))/2 (10); ((5) + 3 X <2))/4 -> (11); 
((5) + 2 X (ll))/3 -> (12); ((5) + (12))/2 -4 (13); ((7) 
+ 3 X (4))/4 -> (14); ((7) + 2 X (14))/3 -> (15); ((7) + 
(15))/2 -> (16) . 

Also at this time, in case m - x > 3 and n - y 
> 3 or 2x < m and 2y < n (see FIG. 22) , a plurality of 
interpolation methods are used. This is because, in 
such a case, it is necessary to select an appropriate 
one thereof according to the length of (m - x) and (n - 
y) . For example, when the lengths of (m - x) and (n - 
y) are smaller (compression rate is smaller) , the linear 
interpolation method (less finer interpolation method) 
may be applied for the white zone, while, when these 
lengths are larger (compression rate is larger) , the 
three-order interpolation method (finer interpolation 
method) may be applied for the white zone. There, each 
of m, n, x and y represents the number of pixels. In 
the example of FIG. 22, n=5;m=5, x=2, and y = 2. 
In this case, the gray zone (to which the nearest pixel 
method is applied as mentioned above) has the width of 
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one pixel, as shown in the figure. This is because, as 
the image data of the gray zone is generated by using 
the black zone as it is according to the nearest pixel 
method, the image quality may be degraded if the gray 
zone has a large area in comparison to the area of the 
black zone. 

FIG. 2 6 shows a flow chart of operation of the 
above-described image data interpolation method 
according to the fifth embodiment of the present 
invention. Assuming that 5x5 pixels are regarded as a 
unit, 2x2 pixels of compressed image data are 
decompressed and restored in a step SI. Then, the image 
data of pixels adjacent to these 2x2 pixels or those 
but excluding the farthest pixel (s) are determined 
through interpolation according to a first interpolation 
method (for example, the nearest pixel method) in a step 
S2 . Then, the image data of the other pixels is 
determined through interpolation according to a second 
interpolation method other than the first interpolation 
method (for example, the linear interpolation method) , 
in a step S3. 

FIGS. 24 and 25 illustrate an example of image 
interpolation method according to a variant embodiment 
of any of the above-described fifth through eighth 
embodiments of the present invention in case a pixel 
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group generated through interpolation will then undergo 
transformation processing, such as magnification 
(increase in the number of pixels) processing. In such 
a case, according to the size-change (change in the 
number of pixels) rate, an appropriate interpolation 
method is set. 

In the example shown in FIG. 24, 2x2 pixels 
are regarded as a unit, and, the image data on pixels in 
a white zone is determined by interpolation. In this 
case, whether a single interpolation method is applied, 
or a plurality of interpolation methods are selectively 
applied is determined according to the size-change rate 
of pixel number change processing which will be 
performed on the thus generated pixels. For example, it 
is assumed that, a case is assumed where the change- 
change rate is 2, and, thus, as shown in FIG. 25, the 

original 2x2 pixels are transformed into 4x4 pixels. 

FIG. 27 shows a flow chart illustrating the 
image data interpolation method according to the above- 
mentioned variant embodiment of the present invention 
applied to the above-described case where the size- 
change processing will be performed after the 
interpolation. In the figure, in a step Sll, the 
compressed data of the 1 x 1 pixel shown in FIG. 24 is 
decompressed and restored. Then, the image data of at 
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least part (only two pixels having the distances in a 
center-to-center basis from the lxl pixel shorter, 
i.e., a and y, in the example of FIG. 24, for example) 
of the pixels adjacent to the 1 X 1 pixel (first zone or 
black zone) is determined according to a first 
interpolation method (for example, the nearest pixel 
method) in a step S12. Then, the image data of the 
remaining pixel (s) (the pixel having the distance in a 
center-to-center basis from the lxl pixel longer, i.e., 
(3 in the example of FIG. 24, for example) is determined 
according to a second interpolation method (for example, 
the linear interpolation method) other than the first 
interpolation method in a step S13 . Then, processing of 
changing (increasing in the case shown in FIG. 25) the 
number of pixels is performed on the thus-obtained 2x2 
pixels of image data, in a step S14. 

FIGS. 28 through 35 show flow charts 
illustrating the above-described image data 
interpolation methods according to ninth through 
sixteenth embodiments of the present invention. 

In FIG. 28, in a step S21, pixels in a first 
zone (black zone in the example of FIG. 16, for example) 
are restored by decompression. In a step S22, the image 
data on pixels (gray zone in the example of FIG. 16, for 
example) adjacent to the first zone is determined 
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according to a first interpolation method (for example, 
the nearest pixel method). Then, in a step S23 , the 
image data on the remaining pixels is determined 
according to a method (for example, the linear 
interpolation method) other than the first interpolation 
method) . 

In FIG. 29, in a step S31, pixels in a first 
zone (black zone in the example of FIG. 19, for example) 
are restored by decompression. In a step S32 , the image 
data on pixels is determined according to a plurality of 
interpolation methods selectively according to distances 
of the relevant pixels in center-to-center basis from 
the pixels in the first zone (for example, the nearest 
pixel method is applied to those nearest to the pixels 
in the first zone, the linear interpolation method is 
applied to those second nearest to the pixels in the 
first zone, and, then, the third-order interpolation 
method is applied to the remaining ones) . 

In FIG. 30, in a step S41, pixels in a first 
zone (black zone in the example of FIG. 16, for example) 
are restored by decompression. In a step S42 , an 
interpolation method (s) to be applied is determined 
according to the size-change (change in the number of 
pixels) rate of pixel number changing processing to be 
performed later. Then, when it is determined in the 
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step S42 that a plurality of interpolation methods are 
selectively applied, the image data of target pixels is 
determined according to a first interpolation method 
(for example, the nearest pixel method, i.e., in case of 
FIG. 14, for the gray zone) determined according to a 
predetermined condition (for example, the pixel-number 
change rate of pixel-number processing performed later, 
or the like, as mentioned above) in steps S43-S44, and, 
then, the image data on the remaining pixels is 
determined according to another method (for example, the 
linear interpolation method or three-order interpolation 
method for the white zone) in a step S45. When it is 
determined in the step s42 that a signal interpolation 
method is applied, the image data of the target pixels 
is determined only according to a single interpolation 
method (for example, the nearest pixel method, the 
linear interpolation method or three-order interpolation 
method described above) determined according to a 
predetermined condition (for example, the pixel-number 
change rate of pixel-number processing performed later, 
or the like, as mentioned above) in a step S46. 

In FIG. 31, in a step S51, pixels in a first 
zone (black zone in the example of FIG. 19, for example) 
are restored by decompression. In a step S52 , the image 
data on pixels (gray zone in the example of FIG. 16, for 
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example) determined from the pixels adjacent to the 
first zone according to the pixel distances in center- 
to-center basis from the first zone is determined 
according to a first interpolation method (for example, 
the nearest pixel method) . Then, in a step S53, the 
image data on the remaining pixels is determined 
according to a method (for example, the linear 
interpolation method or third-order interpolation 
method) other than the first interpolation method. 

In FIG. 32, in a step S61, pixels in a first 
rectangular zone (black zone in the example of FIG. 14, 
for example) are restored by decompression. In a step 
S62, the image data on pixels (gray zone in the example 
of FIG. 14, for example) adjacent to two sides of the 
first rectangular zone is determined according to a 
first interpolation method (for example, the nearest 
pixel method). Then, in a step S63, the image data on 
the remaining pixels is determined according to a method 
(for example, the linear interpolation method or third- 
order interpolation method) other than the first 
interpolation method. 

In FIG. 33, in a step S71, pixels in a first 
rectangular zone (black zone in the example of FIG. 20, 
for example) are restored by decompression. In a step 
S72, the image data on pixels (gray zone in the example 



-67- 



of FIG. 20, for example) adjacent to the four sides of 
the first rectangular zone is determined according to a 
first interpolation method (for example, the nearest 
pixel method). Then, in a step S73, the image data on 
the remaining pixels is determined according to a method 
(for example, the linear interpolation method or third- 
order interpolation method) other than the first 
interpolation method. 

In the above-described processes shown in FIGS. 
32 and 33, assuming that the above-mentioned first zone 
is of a rectangle of x X y pixels (shown in FIG. 14, 
for example) , a second zone is of a rectangle of m X n 
pixels (shown in FIG. 14, for example) , preferably 2x < 
m and also 2y < n. Further, the above-mentioned first 
interpolation method is preferably applied to the gray 
zone having the width of not more than x/2 in the case 
of process shown in FIG. 32, and the above-mentioned 
first interpolation method is preferably applied to the 
gray zone having the width of not more than x in the 
case of process shown in FIG. 33. Further, in the 
process shown in FIG. 32, preferably, m - x > 3 and also 
n - y > 3 . 

In FIG. 34, in a step S81, pixels in a first 
rectangular zone (black zone in the example of FIG. 18, 
for example) are restored by decompression. In a step 
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S82, the image data on pixels (gray zone in the example 
of FIG . 18, for example) adjacent to two sides of the 
first rectangular zone and also determined according to 
the center-to-center-basis pixel distances from the 
pixels in the first rectangular zone is determined 
according to a first interpolation method (for example, 
the nearest pixel method). Then, in a step S83, the 
image data on the remaining pixels is determined 
according to a method (for example, the linear 
interpolation method or third-order interpolation 
method) other than the first interpolation method. 

In FIG . 35, in a step S91, pixels in a first 
rectangular zone (black zone in the example of FIG. 22, 
for example) are restored by decompression. In a step 
S92, the image data on pixels (gray zone in the example 
of FIG. 22, for example) adjacent to the four sides of 
the first rectangular zone and also determined according 
to the center-to-center-basis pixel distances from the 
pixels in the first zone is determined according to a 
first interpolation method (for example, the nearest 
pixel method). Then, in a step S93, the image data on 
the remaining pixels is determined according to a method 
(for example, the linear interpolation method or third- 
order interpolation method) other than the first 
interpolation method. - 
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The present invention may also be realized by 
using an information recording medium such as a CD-ROM, 
a magneto-optical disk, a DVD-ROM, a floppy disk, a 
flash memory, or any other medium such as various type 
5 of ROM, RAM, or the like in which software programs for 
causing a general-purpose computer or the like to 
perform any of the above-described image 
compressing/thinning-out , image 
p decompression/interpolation processing schemes according 

p 10 to the above-described embodiments of the present 

III 

m invention. In such a case, the above-mentioned 

'^T "■■ 
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information recording medium is loaded into a general- 
purpose computer or the like, which then reads the 
software programs therefrom, writes them into a memory 
15 thereof, again reads out the programs therefrom in 

appropriate timing so as to appropriately execute the 
relevant processing schemes. 

Further, the present invention is not limited 
to the above-described embodiments, and variations and 
20 modifications may be made without departing from the 
scope of the present invention. 

The present application is based on Japanese 
priority applications Nos . 2000-396434 and 2001-91594, 
filed on December 27, 2000 and March 28, 2001, 
25 respectively, the entire contents of which are hereby 



-70- 

incorporated by reference. 



□ 

o 

m 
m 
m 
m 

u 

W 
u 

M 

Q 



